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This paper investigates several methods of regression analysis to find relationships and develop predictive 
models that allow accurate calculation of the heat of combustion and content of elements from easy to 
perform chemical analyses. A selection of coals, biomass and bio-char were used for analysis. Bio-char 
can be produced from biomass through various processes and from various types of biomass. Chars from 
biomass were selected due to the increasing interest in this type of material as a solid carbon carrier 
that can be replaced with clean biomass for co-firing with coal. Bio-char is a potential alternative and 
environmentally friendly source of energy. The predictive models developed in this study have been 
validated on an independent data set using cross-validation, providing information about the accuracy 
of the obtained relations. 

© 2013 Elsevier B.V. All rights reserved. 


1. Introduction 

Biomass is the oldest and the third largest source of renew¬ 
able energy currently used in the world [1]. The world primary 
energy demand in 2011 increased 2.5% compared to the previ¬ 
ous year. According to market analysts, global energy demand will 
increase by over 30% by 2035 [2]. Due to the rising price of fos¬ 
sil fuels, renewable energy sources (RES), including biomass, are 
predicted to become the world’s second largest source of electric¬ 
ity by 2035. According to the report of the International Energy 
Agency [1 , the world’s bio-energy sources are sufficient to ensure 
an adequate supply of biomass and bio-fuels for energy purposes, 
without the need to compete with food production. In Poland, 
the main source of energy is still hard coal, which in 2011 was 
used for the production of 62% of the total energy generated. In 
line with the global trend, there is increasing interest in renew¬ 
able energy sources in Poland, among which the most popular is 
biomass. In 2011, the highest (13.7%) increase in energy produc¬ 
tion from renewable sources compared to the previous year was 
recorded [3 . With the increasing use of biomass for the production 
of primary energy (by combustion or co-combustion with coal), 
problems with the physicochemical properties of biomass are being 
observed more frequently, e.g., 
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• A wide range of moisture content causing instability of the com¬ 
bustion process. 

• Different chemical compositions of the ash compared to the coal. 

• Low-density resulting in difficulties in transport and storage. 

• Low energy density. 

• High content of volatile matter. 

These problems may be eliminated (or at least reduced) by pre¬ 
processing biomass into a fuel that has greater stability and is 
characterised by better physicochemical properties (e.g., calorific 
value). The methods of thermal biomass upgrading (such as tor- 
refaction or pyrolysis) are well known. Using these processes, it 
is possible to obtain a fuel with quality parameters comparable 
with hard coal (e.g., high calorific value (Qs a ) up to approximately 
30MJ/kg). These parameters are dependent on the process condi¬ 
tions as well as the properties of the material used. 

2. Materials and methods 

In this research, a few different types of wood biomass were 
used. The tested material was prepared at 40 °C to attain a 2-3% 
moisture content and was then ground to <5 mm. Biomass sam¬ 
ples were pyrolysed in different thermal conditions from 400 °C to 
700 °C. In each test, 100 g of sample was placed in a steel retort and 
pyrolysed in a nitrogen atmosphere. Fig. 1 shows a schematic of the 
biomass thermal conversion work station. 

Nitrogen was purged through the bed from the bottom of the 
retort with a constant flow rate of 3dm 3 /h. Prior to heating, the 
sample was washed with nitrogen for 15 min at a constant flow 


0165-2370/$ - see front matter © 2013 Elsevier B.V. All rights reserved. 
http://dx.doi.org/10.1016/jjaap.2013.08.009 












154 


M. Sajdak et al. / Journal of Analytical and Applied Pyrolysis 104(2013) 153-160 


SOLID FUELS PYROLYSIS SYSTEM 


© 




n 2 





q 

© 


Flow indication 
and control 

Pressure indication 
and control 

Temperature 

indication 


0 


Temperature 
indication and control 


1 Retort - conversion section 

2 Retort - pyrolysis section 

3 Two section heating unit 

4 Cooler 

5 Gas washers 

6 Adsorption filter 

7 Gas storage system 

8 Pressure control valve 


Fig. 1. Diagram of the experimental stand for biomass thermal conversion testing. 


rate of 30dm 3 /h to attain a neutral atmosphere in the retort. The 
retort was heated at a rate of 10 °C/min. When the final temperature 
was reached, the sample was maintained at constant conditions for 
50 min and then cooled to room temperature. The basic parameters 
of the experiments are presented in Fig. 2. 

All of carbonised biomass samples were subjected to 
basic analyses, including the ash content (Ash), volatile 


matter content (VM), fixed carbon (FC), ultimate analy¬ 
sis (C a t , H a t, N a t , S a t and O a t ) and heat of combustion. 
For the development of the prediction, the analysis results 
of carbonised biomass along with pure biomass and hard 
coal of different types were taken into account. The aim 
was to maximise the range of application of the created 
model. 



-Nitrogen flow rate 
-Temperature profile for 741 °C 


-Temperature profile for 500 °C 
-Temperature profile for 600 °C 


-Temperature profile for 700 °C 
-Temperature profile for 458 X 
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Fig. 2. Varying conditions of the biomass thermal conversion tests. 
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3. Proximate analysis 

3.1. Determination of the volatile matter by a gravimetric 
method [4] 

The volatile matter content was measured by weighing a closed 
crucible without air before and after heating at 850 ± 15 °C for 7 min 
and calculating the difference between the total weight loss and the 
weight loss due to water evaporation. 

3.2. Determination of ash [5] 

The ash content of the samples was determined by incineration. 

This method involved placing the sample in a muffle furnace and 
heating it in air at a specific rate to a temperature of815±10°C and 
maintaining this temperature until constant weight was reached. 

4. Ultimate analysis 

4.1. Determination of carbon, hydrogen, nitrogen and sulphur 
content [6] 

The samples were subjected to automatic quantitative combus¬ 
tion in a stream of oxygen at 1150 °C (as a result of the exothermic 
reaction in tin foil, the temperature of the reaction is approximately 
1800 °C). The products of the combustion (CO, C0 2 , NO, N 2 , SO, S0 2 , 
P0 2 , F, 0 2 , H 2 0) were introduced through a quartz bridge into a 
reduction tube where sulphur and nitrogen oxides were reduced to 
S0 2 and N 2 in the presence of copper (the excess oxygen was also 
bonded). The mixture of components (He + N 2 + C0 2 + H 2 0 + S0 2 ) at 
the outlet of the reduction tube was transferred into a dynamic 
separation system, where absorption columns were desorbed ther¬ 
mally in sequence. Analysis of combustion gases (N 2 , C0 2 , H 2 0, and 
S0 2 ) was conducted on a thermal conductivity detector - TCD. Low 
concentrations of S0 2 were analysed with an NDIR detector. 

4.2. Determination of oxygen content [7] 

The direct quantitative analysis of oxygen content was per¬ 
formed by the pyrolysis of a sample in an H 2 0, C0 2 and 0 2 free 
reductive atmosphere (95% N 2 and 5% H 5 ) at 1120-1150 °C. The 
sample was introduced into a pyrolysis tube filled with elemental 
carbon, and carbon oxide was obtained as a result of the reac¬ 
tion between oxygen from the sample and carbon from the filling 
(Boudouard equilibrium). The acidic products of the pyrolysis, such 
as H 2 S, HCN, and HC1, were absorbed on granulated NaOH, and the 
produced water was absorbed by a dehumidifier. The inert products 
of the pyrolysis (N 2 and CH 4 ) were conducted into a measurement 
cell with carbon monooxide. Because the NDIR detector was sensi¬ 
tive only to CO, the other gases did not have to be separated. 

The determination of the elementary composition of C a t , H a t , 
N a t , S a t and O a t was executed with a Vario Macro Cube automatic 
elemental analyser. 

4.3. Determination of the gross calorific value and calculation of 
the net caloric value [8] 

The higher heating value (HHV) was determined by the total 
combustion of 0.5 mg of standard (with a known higher heating 
value) in oxygen atmosphere under pressure in a calorimeter (at 
fixed volume) in an isothermic or adiabatic system and measur¬ 
ing the increase in water temperature in the calorimeter, with an 
allowance for the heat released during the combustion of the wire, 
thread and capsule. 


Each chemometric and statistic operation described in this 
paper was conducted in STATISTICA software (StatSoft, 2012) [9]. 
The collection and analysis of the data are diagrammed in Fig. 3. 

5. Results and discussion 

The results of the technical (proximate) and ultimate analysis 
were gathered in the form of a matrix, against which methods for 
finding the outliers (Grubbs and Tukey’s tests [ 10]) were used. Miss¬ 
ing historic data were replaced by new values using the k-nearest 
neighbour algorithm. The prepared data were input into a matrix 
in STATISTICA 10 [4]. During the analysis, the matrix was divided 
into two groups, teaching and testing, in a 70:30 proportion. Data 
from both groups were analysed using the following methods of 
regression: 

• MARSplines model. 

• SANN model. 

• Random forest model. 

• Boost tree model. 

• Tree model. 

• General regression model. 

• Regression model. 

These methods were used to find and formulate the depend¬ 
ence between the researched variables. The main purpose of this 
research was to describe the relation between the elemental com¬ 
position, heat of combustion, ash content and volatile matter 
content of the analysed samples. 

Analyses for formulating the relation between the heat of com¬ 
bustion and the elemental composition were conducted. These 
types of studies had previously been conducted for specific types 
of materials [11-18]. Several prediction equations were formulated 
for materials originating from one area of occurrence, which signif¬ 
icantly decreased their usefulness. The matrix of data selected for 
this analysis consisted of 900 record-materials from many regions 
of the world. 

To create a function (model) to predict the heat of combustion, 
seven different predictors - independent variables were used. The 
created prediction models, which were the result of the above- 
mentioned methods, were tested using data that were not included 
in the predictive model (test set). Comparability between the model 
and the real data was measured using 10 times cross-validation, 
and data about deviations and matching errors were collected. 

Cross-validation is a model validation technique for the assess¬ 
ment for how the results of an analysis will generalise to an 
independent data set. This technic can be used to compare the 
performances of different predictive modelling procedures. Cross- 
validation is used to evaluate or compare learning algorithms as 
follows: in each iteration, one or more learning algorithms use k - 1 
fold of data to learn one or more models, and then the learned 
models are asked to make predictions about the data in the vali¬ 
dation fold. The performance of each learning algorithm on each 
fold can be tracked using some predetermined performance metric 
like accuracy. 

Values for each of the statistic indices were calculated using the 
equations shown below: 

Mean squared error (MSE) 

n 2 

mse =h£ ( ^-*'-) (1) 

i=i 

where X,- means of n predictions values and x t true values. 
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Fig. 3. Example diagram of the preparation of the data and analysis procedure. 


Mean absolute error (MAE) 


n n 

1 = 1 1 = 1 

where e z is the absolute error and X t the predictions values. 
Standard deviation of mean values 

Jl/CN-iy^Xi-xD 2 

°* = 7n 

where xj is the mean values. 

Relative standard deviation (RSD) 


( 2 ) 


(3) 


O- ^/l/dv-DEL ^'-^) 2 

- Xi~ Xi 

Goodness of fit 


(4) 


X 2 = y 

a z 


Pearson correlation r 


Ejli (Xj-x)(y,--y) 

(n - 1 )SxSy 


(5) 

( 6 ) 


where x and y are the sample means of X and Y, and s x and s y are 
the sample standard deviations of X and Y. 

The results of these calculations are presented in Table 1 , in Fig. 4 
shows a plot the model was characterised by the best goodness of 
fit. 

Table 1 presents the results of the goodness of fit models in 
relation to the real heat of combustion data from the elemental 
and technical analyses. The two highlighted models gave the best 


Prediction model for HHV based on General Regression Method 



HHV [kJ/kg] 


Fig. 4. The scatter plot of real and predictive of heat of combustion values in tested 
materials. 


predictive results. These models were developed using stepwise 
and multiple regression. They are characterised by very high linear 
correlations of approximately 99%, as well as relatively low error 
values of approximately 250J/kg. Fig. 4 shows a plot of the disper¬ 
sion of the real heat of combustion values for the analysed materials 
in relation to the values calculated using formula (7). Dashed lines 
indicate the border prediction value with a precision (accuracy) of 
95%. Additionally, Fig. 4 displays histograms for the real and pre¬ 
dicted values, which elucidate the ranges in which differences may 
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Table 1 

Goodness of fit values of the created prediction models for the determinations of the heat of combustion of materials on the basis of elemental analysis. 


Analysis type 

Mean squared error 

Mean absolute error 

Standard deviation 
of mean values 

Relative standard deviation 

Person’s correlation 
coefficient 

MARSplines model 

491510.27 

340.37 

0.00 

0.02 

0.99 

SANN model 

491297.99 

306.81 

0.00 

0.02 

0.99 

Random forest model 

5279368.31 

1685.96 

0.02 

0.08 

0.96 

Boost tree model 

1534543.14 

777.82 

0.00 

0.04 

0.98 

Tree model 

411891.05 

280.32 

0.00 

0.01 

1.00 

General regression model 

512323.46 

249.38 

0.00 

0.01 

0.99 

Regression model 

512323.46 

249.38 

0.00 

0.01 

0.99 


occur during the prediction process. 

HHV = 601.95 - 11.57 • Ash - 7.12 • VM + 341.67 • C? 

+ 1165.86 • H? - 97.35 • 0? - 193.37 • Nf+110.36 • Sf (7) 

During the analysis, the possibility of decreasing the number of 
variables used from seven to three (proximate analysis) was exam¬ 
ined. Unfortunately, this reduction caused a significant decrease in 
the predictive ability and an increase of the mean absolute error to 
±1500J/kg. 

In supplementary material was included the XML file for STA¬ 
TIST! CA software with the final version of prediction model for heat 
of combustion values (HHX.xml). 

The prediction of the heat of combustion value based on seven 
variables (elemental analysis) is not a difficult task; hence, the typ¬ 
ical regression methods are sufficient. The situation is different 
when we want to create a prediction model for the content of ele¬ 
ments (C a t , H a t , N a t , S a t , O a t ) using only three independent variables 
- volatile matter content, ash content and heat of combustion for a 
given material. For this task, standard regression methods are not 
sufficient. For this purpose, a series of analyses were conducted to 
verify which of the regression methods enables the creation of a 
prediction model for the elemental content using only three vari¬ 
ables. Regression and the classification trees method gave the best 
results, producing a model with good predictive properties. 

Table 2 shows the results of the goodness of fit for each of the 
regression methods used during the construction of a model for 
the elemental carbon content prediction in the analysed material. 
The correlation coefficients for each method are high, above 97%, 
but only the tree model method resulted in a sufficiently low mean 
absolute error value of 1.051% for the carbon content in the analysed 
samples. 


Prediction model for carbon based on Regression Tree Method 



Fig. 5. The scatter plot of the real and predicted carbon values in the tested materials. 


Fig. 5 shows a plot of the dispersion of real and calculated values 
using the developed model (supplementary materials). The dashed 
lines indicate the border prediction value with a precision (accu¬ 
racy) of 95%. As before, histograms were used to show the ranges 
where changes occurred during prediction. In the ranges of40-60% 
and 70-90% carbon content, different quantities of samples in sub¬ 
sequent groups can be seen. This difference is due to the value of 
the mean absolute error with the border value oscillating around 
50% C a , decreasing by 1-2% and causing an increase in samples in 
the lower range of 40-50%. 

In supplementary material was included the XML file for STATIS- 
TICA software with the final version of prediction model for carbon 
(Carbon.xml). 

The prediction of the other elemental (H a t , N a t , S a t , O a t ) contents 
was more complex. The degree of correlation of these elements 
with the analysed parameters (heat of combustion, ash, and volatile 
content) was much lower; therefore, there were no simple lin¬ 
ear dependences between these parameters. For this case, the best 
results were again achieved by the regression trees method. This 
method enables the creation of a strong predictive models, i.e., a 
model with a high linear correlation with respect to the real data 
and a relatively low mean squared error, which in this case was 
0.23%. 

In supplementary material was included the XML file for STA- 
TISTICA software with the final version of prediction model for 
hydrogen determination (Flydrogen.xml). 

The results from Tables 3-6 indicate that the regression tree 
models method gave the highest correlation coefficient values 
among all considered methods. The same was found for the mean 
absolute error, which was six times lower in some situations. The 
figures below (Figs. 6-9) for the dispersion of FI a t , N a t , S a t and O a t 
provide further evidence for the accuracy of the regression tree 
models. 


Prediction model for hydrogen based on Regresion Tree Method 



Fig. 6. The scatter plot of the real and predicted hydrogen values in the tested 
materials. 
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Table 2 

Goodness of fit values of the created prediction models for the carbon determination in solid fuels. 


Analysis type 

Mean squared error Mean absolute error 

Standard deviation of 
mean values 

Relative standard deviation 

Person’s correlation coefficient 

MARSplines model 

11.558 

2.369 

0.004 

0.040 

0.979 

SANN model 

9.696 

2.164 

0.003 

0.038 

0.982 

Random forest model 

17.161 

2.993 

0.007 

0.054 

0.974 

Boost tree model 

11.570 

2.397 

0.005 

0.042 

0.979 

Tree model 

5.528 

1.051 

0.003 

0.020 

0.990 

General regression model 

14.650 

2.723 

0.005 

0.046 

0.973 

Regression model 

14.650 

2.723 

0.005 

0.046 

0.973 


Table 3 

Goodness of fit values of the created prediction models for hydrogen determination in solid fuels. 

Analysis type 

Mean squared error 

Mean absolute error 

Standard deviation of 
mean values 

Relative standard deviation 

Person’s correlation coefficient 

MARSplines model 

1.14 

0.82 

1.04 

0.32 

0.73 

SANN model 

0.59 

0.52 

0.11 

0.17 

0.88 

Random forest model 

0.72 

0.63 

0.07 

0.17 

0.84 

Boost tree model 

1.01 

0.77 

0.09 

0.21 

0.77 

Tree model 

0.24 

0.23 

0.11 

0.09 

0.95 

General regression model 

1.67 

1.00 

0.12 

0.25 

0.57 

Regression model 

1.67 

1.00 

0.12 

0.25 

0.57 


Table 4 

Goodness of fit values of the created prediction models for oxygen determination in solid fuels. 

Analysis type 

Mean squared error 

Mean absolute error 

Standard deviation of 
mean values 

Relative standard deviation 

Person’s correlation coefficient 

MARSplines model 

39.33 

4.76 

0.36 

0.33 

0.90 

SANN model 

23.93 

3.13 

0.12 

0.18 

0.94 

Random forest model 

27.08 

3.76 

0.10 

0.21 

0.94 

Boost tree model 

43.62 

4.88 

0.20 

0.30 

0.89 

Tree model 

S.66 

1.36 

0.00 

0.01 

0.98 

General regression model 

59.24 

6.14 

1.75 

0.53 

0.84 

Regression model 

59.24 

6.14 

1.75 

0.53 

0.84 


Table 5 

Goodness of fit values of the created prediction models for nitrogen determination in solid fuels. 

Analysis type 

Mean squared error 

Mean absolute error 

Standard deviation of 
mean values 

Relative standard deviation 

Person’s correlation coefficient 

MARSplines model 

0.195 

0.331 

0.283 

0.395 

0.650 

SANN model 

0.178 

0.325 

1.287 

0.476 

0.693 

Random forest model 

0.171 

0.321 

0.209 

0.363 

0.725 

Boost tree model 

0.167 

0.320 

0.223 

0.371 

0.717 

Tree model 

0.078 

0.134 

0.054 

0.033 

0.881 

General regression model 

0.281 

0.435 

0.287 

0.446 

0.428 

Regression model 

0.281 

0.435 

0.287 

0.446 

0.428 


Additionally, by analysing the data for oxygen content on a his¬ 
togram, we can distinguish two agglomerations of results (Fig. 7). 
These are from two types of analysed materials, carbonised biomass 
and hard coals with low oxygen content and pure biomass with high 
oxygen content because of lignin, cellulose and hemicellulose. 

In supplementary material was included the XML file for STATIS- 
TICA software with the final version of prediction model for oxygen 
determination (Oxygen.xml). 


The prediction of the nitrogen and sulphur contents was 
the most difficult due to the low contents of these elements 
in the analysed materials and the low degree of correla¬ 
tion with the independent variables used for the modelling. 
The models created during this study, despite having high 
correlation coefficient values, have large mean absolute error val¬ 
ues. 


Table 6 

Goodness of fit values of the created prediction models for sulphur determinations in solid fuels. 


Analysis type 

Mean squared error 

Mean absolute error 

Standard deviation of 
mean values 

Relative standard deviation 

Person’s correlation coefficient 

MARSplines model 

0.63 

0.43 

5.65 

1.14 

0.63 

SANN model 

0.46 

0.33 

204287.83 

103.46 

0.75 

Random forest model 

0.54 

0.35 

0.58 

0.62 

0.74 

Boost tree model 

0.54 

0.38 

1239.03 

3.55 

0.73 

Tree model 

0.07 

0.08 

2.81 

0.39 

0.96 

General regression model 

0.72 

0.46 

617.44 

2.60 

0.54 

Regression model 

0.72 

0.46 

617.44 

2.60 

0.54 
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Prediction model for oxygen based on Regression Tree Method 



Oxygen [%] 


Fig. 7. The scatter plot of the real and predicted oxygen values in the tested mate¬ 
rials. 


Prediction model for nitrogen based on Regression Tree Method 



Fig. 8. The scatter plot of the real and predicted nitrogen values in the tested mate¬ 
rials. 


Prediction model for sulfur based on Regression Tree Method 



Sulfur [%] 


Fig. 9. The scatter plot of the real and predicted sulphur values in the tested mate¬ 
rials. 


Table 7 

Summary table. 


Variable 

Mean [j.m.] 

MAE [j.m.] 

RSD [%] 

HHV [J/kg] 

24238.96 

0.00 

1.00 

C[%] 

62.24 

1.05 

2.00 

H [%] 

4.49 

0.23 

9.00 

0 [%] 

23.12 

1.36 

1.00 

N [%] 

0.98 

0.13 

33.00 

S[%] 

0.47 

0.08 

39.00 


In supplementary material was included the XML file for STA- 
TISTICA software with the final version of prediction model for 
nitrogen determination (Nitrogen.xml). 

In supplementary material was included the XML file for STATIS- 
TICA software with the final version of prediction model for sulphur 
determination (Sulphur.xml). 

6. Conclusion 

The research presented in this article was performed to verify 
which of the available methods of regression analysis can provide a 
predictive model for the determination, with good precision (accu¬ 
racy), of the heat of combustion and elemental composition on of 
a sample based on easy-to-perform chemical analyses. During the 
analysis, it was determined that the model giving the best results 
in terms of the prediction of carbon, hydrogen and oxygen con¬ 
tent was the standard regression tree model method. The relative 
standard deviations for the analysed elements were as follows: 

• 2% for carbon. 

• 9% for hydrogen. 

• 1% for oxygen. 

These models also had coefficients of linear regression greater 
than 0.95 {a = 0.05). 

For the prediction of the nitrogen and sulphur contents, this 
method produced models with high correlation coefficients, but the 
corresponding high mean absolute error values precluded practical 
use. 

In addition to research for the prediction of the present content 
of elements in the analysed materials, the formula for the calcula¬ 
tion of the heat of combustion was derived. This formula enables 
direct calculation of solid fuel heats of combustion based on the 
elemental analysis of C a , H a , N a , S a and O a , as well as the ash and 
volatiles contents. The formula was computed using stepwise and 
multiple regression and is characterised by a high correlation coeffi¬ 
cient and low prediction error of approximately 250J/kg (RSD = 1 %). 
This formula could be used in the software of elemental analysers 
for the direct calculation of the heats of combustion of solid fuels. 

A list of the average values and the absolute and relative 
standard deviations is shown in Table 7. 

The model for the prediction of nitrogen and sulphur is expected 
to be divided into ranges to achieve the best values of MAE and RSD. 

As it was presented in this research, in the situation that there 
is a big data set including results of research a few different kind 
of solid fuels received results of common regressions may be don’t 
satisfactory. In this case the application of the regressions trees 
method would be the proper solution. It does not matter which soft¬ 
ware will be applied into creation of predictive algorithm. Therefore 
STATISTICA, Project R, MATLAB and many other software may be 
applied. 
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